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I. INTRODUCTION 

A large effort has been recently devoted to the study of 
a very large ensemble of interacting systems that can be 
described in terms of complex networks (or graphs), in 
which the vertices represent typical units and the edges 
represent the interactions between pairs of units 0,0, y|. 
Stimulated by this finding, a theory of complex networks, 
deeply rooted in the classical graph theory £| , has hence 
been developed, findingfruitful applications in fields as 
diverse as the Internet [51 |6l HQ, the World- Wide- Web 
, social communiti es 1 1 Oil , food- webs 1 or biological 
interacting networks [12, fl3L fl4L . 

The study of complex networks, boosted by the new 
availability of powerful computers capable to deal with 
very large databases, was initially focused in the study 
of global properties, such as the average shortest path 
length, the average clustering coefficient, or the degree 
distribution 0, 0, • This work led to the discovery that 
most natural complex networks usually exhibit two typ- 
ical properties: (i) The small-world property |l6j . that 
is defined by an average path length — average distance 
between any pair of vertices — increasing very slowly (usu- 
ally logarithmically) with the network size N. (ii) A 
scale-free degree distribution. If we define the degree 
distribution, P(k), as the probability that a vertex is 
connected to k other vertices, then scale-free networks 
are characterized by a power-law behavior P(k) ~ k 1 , 
where 7 is a characteristic degree exponent. These prop- 
erties imply a large connectivity heterogeneity and a 
short average distance between vertices, which have con- 
siderable impact on the behavior of physical processes 
taking place on top of the network, such as the resilience 
to random da mage Il7lll8lll9| or the spreading of infec- 
tive agents [20L El 121123^ 

It was soon realized, however, that these properties do 
not provide a sufficient characterization of natural net- 
works. In particular, these systems seem to exhibit also 
ubiquitous degree correlations, which translate in the fact 
that the degrees of the vertices at the end points of any 



given edge are not independent |7|, |8j, |2J, |25j . This obser- 
vation has led to a classification of networks according to 
the nature of their degree correlations j24[: In the pres- 
ence of positive correlations (vertices with large degree 
tend to connect more preferably with vertices with large 
degree), the network is said to show assortative mixing. 
On the other hand, negative correlations (highly con- 
nected vertices are preferably connected to vertices with 
low degree) imply the presence of dissortative mixing. At 
the same time, it has been pointed out that the presence 
of correlations might have important consequences in dy- 
namical processes taking place in the topology defined by 
the network j2(| [53, [H,!!!] . Motivated by these observa- 
tions, several works have been recently devoted to set up 
a general framework to study the origin of correlations 
in random networks |30L l3l|. At this respect, it is par- 
ticularly interesting the models introduced by Caldarelli 
et al. 32] and Soderberg [sj. These models consider 
graphs in which each vertex has assigned a tag {type or 
fitness), randomly drawn from a fixed probability distri- 
bution. Edges are assigned to pairs of vertices with a 
given connection probability, depending on the values of 
the tags assigned at the edge end points. This construc- 
tion generates random networks which exhibit peculiar 
correlation and percolation properties [32I l33| . 

In this paper we present a generalization of the mod- 
els described in Ref . [33, [33| , that can be encompassed 
in a general class of models with hidden variables tag- 
ging the vertices, and completely determining the topo- 
logical structure of the ensuing network. We develop a 
detailed analysis of the correlations present in this class 
of network models, providing explicit analytical expres- 
sions for both two and three vertices degree correlations. 
We distinguish between sparse networks (with finite aver- 
age degree (k)) and non-sparse networks (with diverging 
(k) for a number of vertices N — > 00). Even though both 
cases are enclosed in this class of networks, analytical ex- 
pressions are simpler in the former case. As an example 
of our formalism, we consider the intrinsic fitness model 
introduced in Ref. 32], which belongs to the subset of 
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non-sparse networks, and that has attracted a great deal 
of attention as an alternative to generate scale-free net- 
works without growth nor preferential attachment 
The solution of this model in the continuous degree ap- 
proximation is compared with extensive numerical simu- 
lations, yielding a remarkable agreement for all the topo- 
logical properties considered. As a particular case of the 
general class of models with hidden variables, we pro- 
pose a practical algorithm to generate correlated random 
networks with a given correlation structure. The algo- 
rithm levers in the assignation of hidden variables with 
the structure of the degrees of a real network. Following 
this approach, it is possible to easily generate networks 
matching any desired correlation pattern, as we show by 
means of analytical calculations and numerical simula- 
tions. Finally, we present the extension of this class of 
models to non-equilibrium growing networks. By map- 
ping the hidden variables to the time in which vertices 
are introduced in the network |33l ]. and by means of an 
appropriately chosen connection probability, we define an 
algorithm that yields networks exhibiting all the proper- 
ties (in particular aging) exhibited by traditional scale- 
free growing models. 

The paper is organized as follows. In Sec. [H] we review 
some general results concerning the measure of correla- 
tions in complex networks, which will be useful through 
the rest of the paper. In Sec. lIIII we introduce the general 
analytical formulation of the class of correlated networks 
with hidden variables. Sec. IIVI is devoted to the ana- 
lytical and numerical study of the intrinsic fitness model 
introduced in Ref. [22. In Sec.[V]we present an algorithm 
to generate correlated random networks with a given a 
priori correlation structure. Sec. I VII deals with the map- 
ping into this class of models of non-equilibrium growing 
networks. Finally, in Sec. IVIII we draw our conclusions 
and perspectives. 



II. MEASURING CORRELATIONS IN 
COMPLEX NETWORKS 

A. Two vertices correlations 

Let us consider the class of unstructured undirected 
networks, in which all vertices with the same degree can 
be considered to be statistically equivalent. In this sense, 
the following results will not apply to structured net- 
works, in which a distance ordering can be defined; for in- 
stance, when the small- world property is absent |27ll35|. 
A network is said to be uncorrelated when the proba- 
bility that an edge departing from a vertex of degree k 
arrives at a vertex of degree kl is independent of the de- 
gree of the initial vertex k. Most natural networks are 
not uncorrelated, in the sense that the degrees at the end 
points of any given edge are not independent. This kind 
of two vertices degree correlations can be measured in 
undirected networks by means of the conditional proba- 
bility P(k' | k) that a vertex of degree k is connected to 



a vertex of degree k' . From the point of view of corre- 
lations, it is useful to consider the restricted subset of 
undirected Markovian random networks [2(j, which are 
completely defined by the degree distribution P(k) and 
the conditional probability P(k' | k). The Markovian na- 
ture of this class of networks implies that all higher order 
correlations can be expressed as a function of P(k' \ k). 

The functions P(k) and P(k' \ k) are assumed to be 
normalized, i.e. 



£i > (*) = £ p (* , l*) = 1 ' 



(i) 



and they are constrained by a degree detailed balance 
condition [2^| stating the physical conservation of edges 
among vertices: The total number of edges pointing from 
vertices with degree k to vertices with degree kl must be 
equal to the number of edges that point from vertices k' 
to vertices k. There is an intuitive way to derive the de- 
gree detailed balance condition |3(| . Let us denote by iVfc 
the number of vertices of degree k. Since J^k = N, 
where N is the size of the network, we can define the 
degree distribution as P(k) — N k /N 50]. To completely 
define the network, we need to specify also how the dif- 
ferent degree classes are connected. To this end, let us 
define the symmetric matrix E kk i , that gives the number 
of edges between vertices of degree k and k', for k ^ k', 
and two times the number of self-connections for k = k' 
(the number of connections between vertices in the same 
degree class). This matrix fulfills the identities 



kN k 



Y,E kk > = (k)N = 2E, 



(2) 
(3) 



k,k' 



where E is the total number of edges in the network. 
This last identity allows to define the joint distribution 



P(k,k') = 



Ekk' 



(4) 



where the symmetric function (2 — 5 kik >)P(k, k') is the 
probability that a randomly chosen edge connects two 
vertices of degrees k and k' . The conditional probability, 
P(k' | fc), defined as the probability that an edge from a 
k vertex points to a k' vertex, can be easily written as 



P(k' | k) 



E k , k (k)P(k,k') 



kN k 



kP{k) 



(5) 



From the symmetry of P(k, k') it follows immediately the 
degree detailed balance condition 

kP(k' | k)P(k) = k'P(k | k')P(k') = (fc)P(fc, k'). (6) 

The joint distribution, P(k, k'), conveys all the informa- 
tion needed to construct a Markovian random network. 
In fact, it is easy to see that 



P{k) 



(7) 
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This relation, together with Eq. (JSJ, completely defines 
the network properties, i.e. P(k) and P(k' | fc), as a 
function of the joint distribution P(fc, k'). Notice that 
Eqs. J5J) and J7|) define the degree distribution and the 
conditional probability in the whole k range, except for 
k = 0. These values can be recovered by noticing that 
P{k' 1 0) = 0, and, from the normalization condition 
Eq. O, 



fc>i 



(8) 



The empirical evaluation of P(k, fc') (or P(k' \ k)) is, 
in most real networks, a quite difficult task, since the 
available data, restricted to finite sizes, usually yields re- 
sults extremely noisy and difficult to interpret. For this 
reason, it is more useful for practical purposes to ana- 
lyze instead the average degree of the nearest neighbors 
ANND) as a function of the vertex degree, defined by 



( 7\ 



k nn {k) = Y J k'P{k'\k). 



(9) 



For uncorrelated networks, in which P(k' \ k) does not 
depend on fc, application of the normalization condition 
Eq. into Eq. ® yields P (k'\k) = k'P(k')/{k). In 
this case, we obtain fc°„(fc) = (fc 2 )/(fc), independent of 
k. Therefore, a function k nn {k) with an explicit depen- 
dence on k signals the presence of degree correlations in 
the network. Based on the ANND, it is possible to char- 
acterize the correlation properties of the network |24j : 
When k nn {k) is an increasing function of k, the network 
shows assortative mixing. Examples of assortative be- 
havior can be found in several social networks [24]]. On 
the other hand, when k nn (k) is a decreasing function of 
fc, the network shows disassortative mixing, as found for 
example is technological systems such as the Internet . 



B. Three vertices correlations 

Correlations among three vertices can be measured 
by means of the probability P(k', k" \ k) that a vertex 
of degree k is simultaneously connected to two vertices 
with degrees fc' and fc". In the particular case of Marko- 
vian networks, this function is related to the two vertices 
correlation through P(k',k"\k) = P{k' \ k)P{k" \ k). 
For non Markovian networks, however, the functions 
P(k' , fc" | fc) and P(k' | fc) are in principle not related. 

Information about three vertices correlations can be 
obtained from the clustering coefficient. The concept 
of clustering in a graph refers to the tendency to form 
cliques (complete subgraphs 4]) in the neighborhood of 
any given vertex. In this sense, clustering implies that 
if the vertex i is connected to the vertex j, and at the 
same time j is connected to I, then, with high probabil- 
ity, i is also connected to I. The probability that two 



vertices with a common neighbor are also connected to 
each other is called the clustering coefficient of the com- 
mon vertex [Tr| . Numerically, the clustering coefficient, 
Ci, of the vertex i can be computed as the ratio between 
the number of edges existing between the ki neighbors of 
i, ei, and its maximum possible value, fc^(fci — l)/2, that 
is, 



2e 4 



ki{ki 1) 



(10) 



On the other hand, the clustering coefficient of a vertex 
of degree fc, c(fc) Q, can be formally computed as the 
probability that it is connected to vertices fc' and fc" , and 
that those two vertices are, on their turn, joined by and 
edge, averaged over all the possible values of the degrees 
of the neighbor vertices. Therefore, we can write c(fc) as 
a function of the three vertices correlations as 



c(fc)= ]T p(k',k"\k) P , 



k'.k" 



(11) 



k' .fe" 



where the function Pk'.k" is the probability that the ver- 
tices fc' and fc" are connected [&l|. The quantity c(fc) has 
been recently used to study the level of hierarchy and 
modularity in real complex networks |37| . 



III. HIDDEN VARIABLE MODELS OF 
CORRELATED NETWORKS 

Recently, Caldarelli et al. [13 and Soderberg (3^ (see 
also Ref. |2a|) have proposed different models of inhomo- 
geneous random graphs that represents a natural gen- 
eralization of the classical Erdos-Renyi random graph 
model [39t |40| . These models consider inhomogeneous 
graphs in which each vertex is characterized by a dif- 
ferent type or fitness. Types can be either discrete or 
continuous variables and are assigned to vertices accord- 
ing to a certain probability distribution. Then, pairs of 
vertices are independently joined by an undirected edge 
with a probability depending on the type of the respec- 
tive end points. This construction leads to an ensemble of 
undirected random networks, which inherits the simplic- 
ity of the Erdos-Renyi model while allowing freedom for 
general forms of the degree distribution and correlation 
structure. Ref. [3j| was mainly concerned with the com- 
ponent distribution and the onset of the giant component 
in this kind of models, and Ref. [32l | reported numerical 
simulations for different model parameters, and analyti- 
cal arguments for the form of the deg ree distribution. 

The models defined in Refs. |32ll33| can be generalized 
as a class of models with hidden variables. The hidden 
variables play the role of tags assigned to the vertices, and 
they completely determine the topological properties of 
the network through their probability distribution and 
the probability to connect pairs of vertices. 

We define the class of models with hidden variables as 
follows: Let us consider a set of N disconnected vertices 
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and a general hidden variable h, that can be a natural or 
a real number. An undirected graph is generated by the 
following two rules: 

1. Each vertex i is assigned a variable hi, inde- 
pendently drawn from the probability distribution 
p(h). 

2. For each pair of vertices i and j, with respective 
hidden variables hi and hj, an undirected edge is 
created with probability r{hi,hj) (the connection 
probability), where r(h, h') > is a symmetric func- 
tion of h and h! . 

Given the independent assignment of hidden variables 
and edges among vertices, this procedure generates cor- 
related random networks with neither loops nor multiple 
edges, which are Markovian at the hidden variable level 
|52| and whose degree distribution and correlation prop- 
erties are encoded in the two functions p(h) and r(h, h'). 
Here we will focus in the case in which the distribution 
p{h) is independent of the network size N . The case in 
which p(h) is allowed to depend on N will be considered 
in Sec. EH 

In this Section we will provide analytic expressions for 
the correlation function and clustering coefficient of the 
networks generated with this class of models as a function 
of the distribution of hidden variables and the probability 
to connect pairs of vertices. 

A. Degree distribution 

The degree distribution, P(k), is defined as the prob- 
ability that any given vertex has k edges attached to it. 



where g\ n ' '(fcj | hi) is the probability that a vertex with 
hidden variable h ends up with fcj connections with ver- 
tices of hidden variable hi, h c being the maximum value 
of h. Since the connections between vertices with hidden 
variables h and h' are independently drawn with proba- 
bility r(h, h'), the probability g^ h \ki | hi) is simply given 
by a binomial distribution, i.e. 

9l h \k i \hi) = (f^r(h,hi) k '[l-r(h,h i )} Ni - ki , (17) 

where Nj — Np(hi) is the number of vertices with hidden 
variable hi. Let us define now the generating function 



Therefore, in order to compute it, we need to know the 
conditional probability g(k \ h) (propagator) that a ver- 
tex with initial hidden variable h ends up connected to 
other k vertices. The degree distribution can then be 
written as 

P(k) = J29(k\h)p(h), (12) 

h 

where the summation sign must be exchanged by an in- 
tegral for continuous h. The propagator, which is obvi- 
ously normalized, ^2 k g(k | h) = 1, provides full informa- 
tion about the dependence of the actual degree k on the 
hidden variable h. In particular, we can see that the av- 
erage degree of the vertices with hidden variable h, k(h), 
is given by 

k(h) =^2kg{k\h), (13) 

fc 

and the average degree can be expressed as 

<fc>=£fcP(fc) = (14) 

fc _ h 

On the other hand, the probability that a vertex of actual 
degree k has associated a hidden variable h, g*(h | k), can 
be computed as the inverse of the propagator by means 
of Bayes' formula |4lj . 

P(k)g*(h\k) = p(h)g(k\h). (15) 

In order to get an explicit expression for the propaga- 
tor, we start by noticing that it can be written as 



(16) 

I 

m 

g(z\h)=J2z k 9(k\h). (18) 

fc 

Since the propagator is given by a convolution, Eq. i|16[l , 
we can write its generating function as the product 
of the generating functions of the partial propagators 
gl_ h \ki | hi), which on their turn, being binomial distri- 
butions, yield 

g i t\z\h l ) = [l-{l-z)r{h,h^ . (19) 

Inserting this expression into the definition of g(z \ h) and 
taking logarithms on both sides we are led to the equation 



J 



g(k \h)= Yl 9[ h) (h | h 1 )gf\k 2 | h 2 ) ■ -gi h \k c | h c )S kl+k2+ ... +ke<k , 

fel j ■ ■ 
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lng{z\h)=Nj2 P{h') In [1 - (1 - z)r{h, ti)} . (20) 
h' 

For general probabilities p(h) and r(h, ti), Eq. 1)20(1 must 
be solved and inverted in order to obtain the correspond- 
ing propagator. The degree distribution is then obtained 
applying Eq. 1)12(1 . Even without solving the previous 
equation, however, it is already possible to obtain some 
information on the connectivity properties of the net- 
work. From the definition Eq. 1(181) . the first moment of 
g(k | ti) is given by the first derivative of g(z \ ti) evaluated 
at z = 1. Therefore we have 



and 



~k(h) = Nj2p(h')r(h, ti), 



(k)=N^2p(h)r(h,h') P (h') ) 

h,h' 



(21) 



(22) 



where we have used Eq. ((20(1 in computing these expres- 
sions. 

At this point we must consider the possibility of two 
different kinds of networks: Sparse networks, with a well- 
defined thermodynamic limit for the average degree (k), 
and non-sparse networks, in which the average degree 
diverges with the network size. In the case of sparse 
networks, the number of edges grows linearly with the 
system size and, therefore, the joint distribution is a 
well defined quantity, independent of N. In the oppo- 
site case, non-sparse networks have a number of edges 
growing faster that linearly which causes the breakdown 
of the thermodynamic limit and the emergence of the 
phenomenon of condensation of edges (see Sec. IIV(I . In 
order to distinguish between sparse and non-sparse net- 
works we must consider the value of the average degree, 
given by Eq. I(22|) . If the density p(h) is independent 
of the size of the system, the only possibility to have a 
sparse network is that the connection probability scales 
as TV -1 . This scaling behavior turns out to have a strong 
implication in the form of the propagator. Defining 
r(h,ti) = C(h,h')/N (as considered in Ref. Hi|), where 
C(h,ti) is a bounded symmetric function, independent 
of N, we can expand the right-hand-side of Eq. I(20|) in 
the limit N — > oo to obtain 



g(z | ti) = exp \{z - 1) p{h')C(h, ti) 



B. Degree correlations 

Degree correlations are completely characterized by 
means of the conditional probability P(k' \ k), that gives 
the probability that an edge emanating from a vertex of 
degree k is connected to a vertex of degree k' . In order 
to construct the function P{k' \ k) we consider a vertex of 
degree k, that with probability g*(h \ k) has associated a 
hidden variable h. Let us define piti | ti) the conditional 
probability that a h vertex is connected to a ti vertex. 
Then, the conditional probability P(k! \ k) can be written 
as 



P(k' \k) = Y 9(k' - 1 1 h')p(ti I h)g*(h | k), 



(25) 



h.h' 



where the propagator g(k' — 1 | ti) gives the probability 
that the ti vertex ends up with degree k' (since one con- 
nection has already been used up for the conditional edge 
with h) . Using the form of g* (h \ k) given by Eq. 115|) we 
have 



P(k' | k) 



1 



P(k) ^ 

v ' h,h' 



g(k'-l\ti)p(ti\h)p(h)g(k\h), 



(26) 

valid for k, k' = 1,2,.. .. In order to close Eq. 126(1 . we 
need, finally, to provide an expression for the conditional 
probability p(ti \ ti). In order to do so, we consider that 
the probability of drawing an edge from h to ti is pro- 
portional to the probability of finding an ti vertex, times 
the probability of creating the actual edge. Taking into 
account normalization, we have that 

P (ti\h)= em^in = M!WQ, (27) 



E h »p(h")r(h,h» 



k(h) 



Finally, using Eqs. ((26(1 and 127(1 we can compute the 
ANND as 

k nn {k) = 1+ p^£ff(*|/i)p(&)**T.(J0, (28) 

where we have defined the ANND of a h vertex (see 
Eq. ©) as 



k nn (h) = J2Hh')p(ti\h). 



(29) 



(23) 



h' 



The generating function of the propagator is a pure ex- 
ponential, which indicates that the propagator itself is a 
Poisson distribution, 



g(k\h) 



-k(h) 



k{ti) h 



k\ 



(24) 



where in this case k(h) = YjhP( h ')C{h,ti). Eq. (H3J) is, 
indeed, a strong result since is states the universality of 
the propagator for sparse networks regardless of the form 
of the connection probability. 



C. Clustering coefficient 

The clustering coefficient is defined as the probabil- 
ity that two vertices, adjacent to a third vertex, are also 
connected to each other. In the space of hidden vari- 
ables, consider a h vertex, which is connected to two 
other vertices ti and h" with probability p(ti, h" \ ti). On 
the other hand, ti and h" are connected with probabil- 
ity r(h',h"). Therefore, the clustering coefficient of a 
vertex h in given by Ch — Ylh' h" P(ti , ti' \ h)r(ti , h"). 
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Note that this is the natural counterpart of Eq. (|llfl in 
the space of hidden variables. Now, since the network 
is Markovian at the hidden variable level, we have that 
p(h', h" | h) = p{h' | h)p(h" | h). Thus we have that 

c h = ^p(h'\h)r(ti,h")p(h"\h). (30) 

h',h" 

The clustering coefficient of the vertices of degree k, c(fc), 
will be given by the probability that a vertex k has hid- 
den variable h, g*(h | k), times Ch, averaged over all the 
possible values of h. Thus 

m=p^- ) Jlp(h)g(k\h) Ch , fc = 2,3,..., (31) 

where we have used the form of g*(h\k) given by 
Eq. 113). 

The results derived in this Section represent the gen- 
eral solution of the class of networks with hidden vari- 
ables. In the rest of the paper we will show how this 
formalism is able to deal with a wide variety of models, 
from sparse to non-sparse networks, and from equilibrium 
to non-equilibrium ones. 

IV. THE INTRINSIC FITNESS MODEL 

As an example of the general class of models with hid- 
den variables, Caldarelli et al. [32| considered the model 



defined by the probability distributions 

p{h) = e~ h for h £ [0,oo[, (32) 
r(h,ti) = 0{h + h'-C), (33) 

where 6(x) is the Hcaviside step function and ( is a con- 
stant. In this model, hereafter referred to as the intrinsic 
fitness (IF) model, vertices have assigned an exponen- 
tially distributed hidden variable (fitness), and are joined 
by an edge whenever the sum of the fitness of the end 
points is larger than a given threshold C- By means of nu- 
merical simulations and analytical arguments, Caldarelli 
et al. |32j showed that the degree distribution in this 
model is power-law distributed. This observation led to 
the very interesting conclusion that it is possible to gen- 
erate scale-free networks without growth not preferential 
attachment |34j . 



A. Analytic solution 

Using the general formalism developed in the previous 
Section, we can provide analytic expressions for the main 
properties of the IF model. In order to do so, let us com- 
pute in the first place the propagator g(k\h). Inserting 
Eqs. (|32"|> and (|3^|) into Eq. JSUJ), we have, substituting 
the summation by an integral, 



\ug{z\h)=N dtie-' 1 ' \n[l - (1 - z)6(h + ti -()}=N\nzl e ~ " * , (34) 

Jo { 1 if h > C 

from where we obtain g(z \ h) — z Ne C for < h < (, and g(z \ h) = z N for h > £■ In order to invert this generating 
function, we approximate k by a continuous variable. In this case, the propagator takes the simple form 

g(k | h) = 5(k - Ne h ~ c )9 h (0, () + 5(k - N)9(h - C), (35) 

where 5(x) is the Dirac delta function and we have introduced the window function 

e x (a,b) = l 1 fOTa ^ 6 . (36) 
1 otherwise 

This approximation is expected to perform poorly for small values of fc, as we will see when comparing the analytical 
results with computer simulations of the IF model. 

Inserting the propagator Eq. (|35() into the general expression Eq. I|12l) , and performing the integrals corresponding 
to the Dirac delta functions, we obtain the degree distribution 

P(k) = Ne- ( ^9 k (Ne-C,N) + e~ c <5(fc - N). (37) 
k 

That is, the networks generated by the IF model exhibit a scale-free degree distribution, with degree exponent 7 = 2, 
for degrees in the range 7Ve~^ < k < N, plus an accumulation point at k = N, given by the delta function, with 
weight e — This accumulation point signals the presence of a condensation of edges in the fraction e - ^ of the vertices 
of the network with h > ^, that establish connections to all the other vertices |43(. This condensation, reminiscent 
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to that observed in models with non-linear preferential attachment 44f, is the result of the non-sparse nature of the 
network, that, from Eq. J22J, has average degree (k) = iVe~^(C + 1). 

In order to characterize the correlations of the model, we compute the ANND, given by Eq. J2HJ- In the continuous 
k approximation, the function k(h) takes the form 

Ne h - c 6 h (0,Q+N6(h-O- 



k(h) 

Inserting this expression into the formula for the ANND, we obtain 



knn(k) — 1 + 



iv e - 2 c 



(1 + ()5(k -N) + ^{\ + , 



ml - 

N 



9 k (Ne- c ,N) 



(38) 



(39) 



The regular part of this expression (discarding the delta function singularities, signaling again the effect of the 
condensation of edges in the correlation function) takes the form 



K n (k) = 1 + 



1 + ^ + l ^N 



h(Ne-<,N) 



(40) 



That is, the regular part of the ANND is proportional to fc _1 , times a logarithmic correction term. We are therefore 
in the presence of disassortative mixing. Note that, in the limit N — > oo, we have that k^ n (k) — > oo, in agreement 
with the theoretical prediction made in Ref. p9|. 

Finally, to estimate the clustering coefficient, we have to compute first the conditional probability at the level of 
hidden variables, given by Eq. I|27|) . Using Eqs. i|32[) and (|33|) . we obtain 



p(h' | h) = e- h '9(ti + h-0 [e*- h e h (p, + 0(h - 0] . 
From this expression we can obtain the clustering coefficient at the level of the hidden variables 

c h = 9 h (0, C/2) + e^ 2h (2h - C + l)^(C/2, C) + e~ C (C + l)6{h - Q, 
and the clustering coefficient as a function of the degree k, 



(41) 
(42) 



c(k) 



+ J^-f~ 2<: (C + l)S(k-N). 



2 In — +C + 1 



The regular part of this formula is finally 

c r (k) = 6» fc (Ae~ c ,7Ve~ c/2 ) + 



N 2 e- ( 
~~k? 



c 








Hi) 


+ C + 1 







%{Ne^/ 2 ,N). 



(43) 



(44) 



That is, for k < iVe - ^ 2 the clustering coefficient is constant and equal to its maximum possible value 1. The presence 
of this flat region in the clustering coefficient is easy to understand. The degree range k < Ae~^/ 2 corresponds, from 
Eq. I]38p. to vertices with fitness h < Q/2. These vertices can only establish connections with vertices with b! > C/2, 
which arc on their turn fully interconnected among them. From here, it follows a maximum clustering coefficient 
equal to 1 for all vertices with h < C/2. On the other hand, for JVe - ^ 2 < k < N, the clustering coefficient decreases 
as k~ 2 , modulated again by a logarithmic correction term. 



B. Numerical simulations 



In order to check the validity of the proposed analytical expressions, we have performed numerical simulations of 
the IF model. To simplify the comparison, we have considered the particular case C = hiiV, in which the relevant 
expressions take the form: 



P(k) - JLe k (l,N) + if8{k-X) 



knn(k) — 



1 + N 



N 
1 + lnfc 

k 



B k (l,N) 



c r (k) = k (l,N^ 2 ) + ^ 



In 



M/2 



e k (N^ 2 ,N) 



(45) 
(46) 

(47) 
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Simulations were performed for networks of size N = 10 4 (corresponding to ( — lnlO 4 f» 9.2103), averaging all 
statistical distributions over 10 3 to 10 5 network realizations. 

In Fig. H we depict the results corresponding to the degree distribution. As we can see, the theoretical prediction 
(solid line) overestimates the value of the actual degree distribution for small k. This is a natural effect of the 
continuous k approximation, that can be readily understood from the form of Eq. (|45|l : The form P{k) ~ fc~ 2 cannot 
be correct in a discrete approximation, since it does not fulfill the normalization condition. The condensation of edges 
at k = N is clearly visible in the presence of an isolated peak, of height approximately equal to TV -1 . Figs. [3 and |3 
on the other hand, represent the ANND and the clustering coefficient as a function of the degree fc, respectively. As 
we can see, the fit between the computer simulations and the analytical expressions is quite good. 



r 





FIG. 1: Comparison between the theoretical prediction 
Eq. I|450 for the degree distribution (solid line) and computer 
simulations (hollow circles) of the IF model. Fhe isolated 
point at k = N corresponds to the analytical Dirac delta 
function, with strength e - * = TV -1 . 



V. A PRACTICAL ALGORITHM TO 
GENERATE CORRELATED RANDOM 
NETWORKS 

The hidden variable class of models represents a nat- 
ural extension of the Erdos-Renyi random graph model, 
that allows to generate a broad class of correlated net- 
works from which it is possible to compute the most rel- 
evant topological properties. From a practical point of 
view, however, it is still missing an important point. In- 
deed, there are many situations in which it is desirable 
to generate a network with a particular correlation struc- 
ture given by a certain joint distribution P(k 1 k'). For 
a hidden variable model it is possible to compute this 
quantity as a function of the initial probabilities p(h) 
and r(h,h'). However, this relation is non-trivial, and it 
is generally not possible to invert it. Therefore, in order 
to implement an algorithm capable to generate networks 
with any a priori correlation structure one must care- 
fully choose the distribution of hidden variables and the 
connection probability. 



FIG. 2: Comparison between the theoretical prediction 
Eq. 14611 for the ANND (solid line) and computer simulations 
(hollow circles) of the IF model. 



One possible way to proceed is to define hidden vari- 
ables h that have themselves the structure of the de- 
grees of a real network (hidden degrees), with correlations 
given by a joint distribution P(h, hf). Those hidden de- 
grees will then be natural numbers, that are assigned to 
the vertices according to the probability distribution (see 
Eq. 0) 



(48) 



with (h) — Y^h hp{h). In order to define the connection 
probability, we consider that, if the hidden degrees were 
the actual degrees characterizing the network, then the 
total number of edges between vertices h and h! would 
be Ehh' — (h)P(h, h')N. Since the total number of h 
vertices is Nh — Np(h), it is therefore natural to define 



r(h, ti) 



(h) P{h,ti) 
^p{h) P {h>) 



(49) 



On the other hand, the conditional probability that a ver- 
tex h is connected to a vertex h! is given by (see Eq. (J5J) 
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FIG. 3: Comparison between the theoretical prediction 
Eq. 1471 for the clustering coefficient as a function of the de- 
gree k (solid line) and computer simulations (hollow circles) 
of the IF mode. 



p(ti | h) = 



(h)P(h,h') 
hp(h) ' 



(50) 



The quantities p(h) and p(h' | h) will be, in this case, 
related through the hidden degree detailed balance con- 
dition, 

hp(ti | h)p(h) = h'p(h | h')p(h') = (h)P(h, ti), (51) 

as can be checked by inserting into the definition of 
p(h'\h), Eq. lj!TT)l. the expression Eq. (gHJ. It is in- 
teresting to note that, if two-point correlations are ab- 
sent at the level of the hidden variables, then we have 
that P (h,ti) = hh'p(h)p(h')/{h) 2 . Thus, the connec- 
tion probability reads 



r (h,ti) 



hh' 



(52) 



recovering the model recently introduced by Chung and 
Lu (see also Ref. 0). ' 

Assuming that the connection probability is bounded 
and decreases for large network sizes as A -1 , we can 
compute the propagator g(k | h) applying Eq. I|24|) with 
k(h) = N ^2 h , p(h')r(h,h') — h, where we have used 
Eq. (|49|) . Therefore, the propagator is a simple Poisson 
distribution, with average value h, i.e. 



g(k | h) 



^ — huk 



k\ 



(53) 



Note that the validity of this result levers on a quite 
strong assumption for the boundedness of the connection 
probability r(h, h'). The nature of this condition is more 



clearly seen in the case of uncorrelated networks, with 
ro(h, h') = hh'/N(h). If r (h 7 h!) has to decrease as A -1 , 
then the maximum value of the hidden degree must be 
smaller than h c (N) = (N(h}) 1/2 a condition that 
imposes restrictions on the maximum degree available 
for any vertex. 

From the propagator Eq. (|53() . the degree distribution 
as a function of p(h) follows immediately from Eq. 



k\ 



-p{h). 



(54) 



This relation between distributions implies a relation be- 
tween the respective moments. Indeed, it is straightfor- 
ward to prove that 

(h n ) = (k(k-l)---(k-n+l)), (55) 

and, in particular, the first two moments read 

(h) = (k), (h 2 ) = (fc 2 ) - (fc>. (56) 

It is also instructive to see how we can recover the clas- 
sical Erdos-Renyi random graph model from this formal- 
ism. The Erdos-Renyi model corresponds to joining pairs 
of vertices with a constant probability p. Such connection 
probability results from imposing uncorrelated hidden 
degrees with distribution /Oer(/i) = 5/fc),/i, which yields 
a Poisson degree distribution with average degree (fc). 

In order to compute the ANND function from Eq. I|28|l , 
we observe that in this case k{h) — h. From here we 
obtain 



-,—huk 



fc! 



-p(h)h nn (h), (57) 



where, in this case, the average hidden degree of the near- 
est neighbors as a function of h (see Eq. (I29H ) is 



h nn (h) = J2h' P (h'\h) 



(h) 
hp{h) 



Y^h'P{h,h'). (58) 



For uncorrelated networks at the hidden level, the ANND 
yields 



(h) (fc) ' 



(59) 



recovering the well-known result |42']. Finally, the clus- 
tering coefficient takes, from Eq. H31fl . the form 



1 x ^ e 



— huh 



fc! 



-p(h)ch, 



(60) 



where the clustering coefficient in terms of the hidden 
degrees is given by 
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Ch 



= ^p(h'\h)r(h',h")p(h"\h) = 



h'h' 



h 2 p(h) 2 N 



E 

h',h" 



P(h,h')P{h',h")P{h",h) 

p{h') P {h") • 



(61) 



When correlations are missing in the hidden degree dis- 
tribution, we obtain 



-o 



(fc) 



{hY ({k 2 ) (fc)) 2 



N(k} 3 



(62) 



recovering the result previously derived by Newman |48| . 

The key point to notice in the above expressions is 
that the Poisson propagator Eq. is a sharply peaked 
function at k = h, that in the large k limit is analogous 
to a delta function 5h,k- Therefore, in the limit k — > oo, 
we expect to observe the behavior 



P(k) 

k n n{k) 

m 



P(k), 

1 + h nn (k), 

Ck- 



(63) 
(64) 
(65) 



That is, the main topological properties referred to the 
actual degree k tend to their analogs computed for the 
hidden degree h, with the sole exception of a constant of 
order unit added to the ANND function. We can take 
advantage of this observation to propose the following 
algorithm to generate a correlated random network with 
theoretical degree distribution Pt(k) and joint distribu- 
tion P t (k,k'): 

1. Assign to each vertex i an integer random variable 
ki, i = 1 • • • N, drawn from the probability distri- 
bution Pt(k). 

2. For each pair of vertices i and j, draw an 
undirected edge with probability r(ki,kj) = 

{k)P t (k t ,k)/ Np tCh) p t(k)- 

The outcome of this process will be a random network 
whose actual degree structure, in the large k limit, will 
be distributed according to the probability Pt(fc), with 
correlations given by Ft(fc, k'). 

In order to check the accuracy of the previous algo- 
rithm, we have tested it with the joint probability distri- 
bution 



P t (k,k')=Aq 



kk' 



k j k — .1. . 2. , , 



(66) 



where A is a normalization constant and q < 1 is a con- 
stant parameter. With this choice, the degree distribu- 
tion takes the form 



Pt{k) 



{k)Aq k 
k(l-q k Y 



(67) 



which, for q — > 1, approaches a power-law distribution 
with exponent 7 = 2. In Figs. O and we present the 
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Theoretical 
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FIG. 4: Degree distribution obtained from numerical simula- 
tions of the proposed algorithm, applied to the joint distribu- 
tion Eq. 1661 , compared with the theoretical and transformed 
values. 



results for the degree distribution, the ANND function, 
and the clustering coefficient, respectively, from com- 
puter simulations of the proposed algorithm, using the 
joint probability distribution given by Eq. (|66|) . The plots 
have been obtained for networks of size N = 10 4 and a 
parameter q = 0.999, averaging over 10 3 realizations. In 
the same graphs we also represent the theoretical values 
corresponding to a network with a correlation structure 
given by Pt(k,k / ), plus the transformed functions given 
by Eqs. l(57|) . and (|rJUl) . respectively, that correspond 
to the actual topological properties of the network. As 
discussed previously, and to ease the comparison of the 
plots, a factor 1 has been subtracted to the ANND func- 
tion obtained from computer simulations and the trans- 
formation Eq. H57f) . We can see that for all three quan- 
tities, the matching between the computer simulations 
and the theoretical results is very good for values of k 
larger than 10. Being the discrepancy limited to such 
small degree values, we conclude that the proposed algo- 
rithm reproduces the desired correlation structure with 
an accuracy that is more that satisfactory for any purpose 
dealing with the large scale properties of the network. 
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k 

FIG. 5: ANND function obtained from numerical simulations 
of the proposed algorithm, applied to the joint distribution 
Eq. 166H . compared with the theoretical and transformed val- 
ues. 




k 

FIG. 6: Clustering coefficient obtained from numerical sim- 
ulations of the proposed algorithm, applied to the joint dis- 
tribution Eq. I|66|l . compared with the theoretical and trans- 
formed values. 



VI. NON-EQUILIBRIUM CORRELATED 
RANDOM NETWORKS 

The class of models we have introduced so far are static 
models, in which, starting from a fixed number N of ver- 
tices, edges are assigned with a given probability. As we 
have seen, this construction is extremely useful because 
it gives us control over the final network structure and, 
at the same time, the possibility to calculate important 
structural properties. Many real networks, however, are 
far from being static. Instead, many of them are the re- 
sult of an evolving process 3] , in which vertices are added 



to the network following some growing process (lineal, 
exponential, etc.), establishing connections to other ex- 
isting vertices with a given attachment rule (preferen- 
tial attachment [34|], deactivation of vertices [3f|, etc). 
From this growing mechanism the network reaches a non- 
equilibrium steady state where the statistical properties 
are time independent. 

In the following we will see how it is possible to map 
non-equilibrium growing networks into a particular kind 
of models with hidden variables. The key point is to 
realize that, after the growth of the network, all vertices 
that joined the network at the same time are statistical 
equivalent and, thus, the hidden variable of a vertex must 
correspond to its injection time, t . We consider a 
time window t £ [to, T], with T 0, in which the initial 
time can be taken to = 1 without lack of generality. If A is 
the rate of creation of new vertices per unit time |53| the 
network size is given by N = X(T — 1). In this case, the 
density of hidden variables, p(t), is a uniform distribution 
defined in the range [1,T], that is, p(t) = 1/(T - 1), 
reflecting the linear growth of the network. The main 
difference between this class of non-equilibrium networks 
and the classes discussed in the previous Sections lies in 
the fact that the distribution p(t) has now an explicit 
dependence on the system size N (or the final time T). 

The next step is to define the connection probability 
of two vertices that joined the network at times t and 
t', r(t,t'). The choice of this function is equivalent to 
the connection probability at the time that the vertices 
were added and its specific form will determine the final 
properties of the network. For instance, an homogeneous 
form for r(t,t'), that is, r(t,t') = f(\t — t'\), will produce, 
in the large T limit, networks in which all the vertices 
will have the same statistical properties, independent of 
the injection time. In the opposite case of inhomogeneous 
networks, vertices introduced at early times will have dif- 
ferent topological properties than those added later, giv- 
ing rise to aging (that is, an explicit dependence on the 
injection time t of all the vertex properties evaluated at 
time T > t). 

In order to provide a particular example, we focus 
on the class of growing scale-free networks, whose most 
characteristic element is the Barabasi- Albert model [34| . 
From general scaling arguments 0, Q , it is possible to 
see that growing scale-free networks are described by a 
power-law degree distribution P(k) ~ fc~ 7 , while the av- 
erage degree at time t of a vertex introduced at time t' 
is given by 

h'{t)~(jp) - 0</3<l, i>i'>l, (68) 

where the exponents p and 7 fulfill the scaling relation 

7 = l + i (69) 

In the Barabasi- Albert model, corresponding to j3 = 1/2 
and 7 = 3, new edges are joined to old vertices follow- 
ing a preferential attachment prescription, that is, with 
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probability proportional to the degree of the existing ver- 
tices. We can generalize this prescription and consider a 
preferential attachment as a function of the time t, map- 
ping the degree to the time by means of Eq. I|t)8[) . In this 
case, however, when a new vertex is added at time t, it 
can establish connections with nodes introduced between 
1 and t and, consequently, the connection probability is 
to be rescaled by a factor J"' kt>(t)dt' , that is proportional 
to t. Therefore, the probability that a new vertex, cre- 
ated at time t, will be joined to a vertex injected at time 
t' < t, is proportional to (t/t') 13 /t. 

Following this reasoning we propose a connection prob- 
ability as a function of the times t and t' given by 



r(t,f) = ' 



Q{t-t') + 



6(t' - 1) 



where a is a parameter that controls the final average de- 
gree of the network. The connection probability has been 
symmetrized for t and t' to comply with the general con- 
ditions of this function. Its symmetric property, however, 
does not imply that the average properties of the vertices 
are independent of t. For example, computing the aver- 
age degree of a t vertex (introduced at time t) , evaluated 
at the final time T, using Eq. J2J, we obtain [54| 



k(t) = X J r(t,t')dt' 



1-/3 V t 1 ' J \ V t 



For large T, we have k(i) ~ (T/t)! 3 , recovering the behav- 
ior obtained in growing network models, Eq. (jfiSJ) . if we 
consider the time T as the observation time. On the other 
hand, k(t) is a decreasing function of t between the lim- 
its t = 1, yielding k max ~ aXT 13 //3, and t = T, where it 
converges to the constant k m i n ~ aX/ (1 — /?). This func- 
tional form implies that the oldest vertices (with smaller 
t) have a larger avera ge d egree, which is the signature of 
aging in the network |34| . 



From Eq. JUJ), the average degree of the network can 
be computed as 



k(t)dt 



2aX ( IT 13 - I 



1 — — - 



1-/3 V /3 T-l 



(72) 



that, in the limit of large T and < 1, tends to (k) = 
2aA/(l — /3), from where we identify the normalization 
parameter a as a function of the average degree. For 
(3 = 1, on the other hand, the average degree diverges as 
(k) ~ 2aAlnT. Note that this choice of the connection 
probability, independent of the network size, yields for 
/3 < 1 a sparse network (with finite average degree in 
the thermodynamic limit), in opposition with the case 
discussed in Sec. IIIII This fact is due to the explicit 
dependence on N of the distribution of times pit), and 
signals the crucial difference of non-equilibrium networks 
with hidden variables. 

In order to obtain the form of the degree distribution, 
we observe that, even though the network is sparse, since 
r(t,t') is not proportional to /V -1 we cannot rigorously 
apply Eq. (|24|) . However, we note that the maximum 
value of r(t, t') takes place at t = t' , namely 



r(t,t) = - = ML~g). 
v ; t 2Xt 



(73) 



For not very large values of (k) and large t, the connec- 
tion probability is bounded by an small value, and there- 
fore we can still approximate its propagator by means 
of Eq. 1241) . Working for simplicity with the generating 
function of the degree distribution, P(z) — J^k z k P{k), 
we therefore write, from Eq. J22J), 



P{z) 



T-l J, 



(74) 



Performing the change of variables r = t/T, and consid- 
ering the limit T — > oo, we obtain 



P(z) = cxp 



aA(2/3-l)(z-l) ) f 1 p _ aX{1 _ z)T -? 
(3(1 -(3) 



3 ^d7 



aX 



(l-z) 



r(-l//3,aA(l - z)/(3) (aX(2(3- l)(z- 1) 
]3 eXP \ W^[3) 



(75) 



where T(x,y) is the incomplete Gamma function. Ex- 
panding P(z) around z = 1, we obtain the leading terms 



P(z ) ^l- { k)(l-z) + [^Y T ±MH(l-z)^. 

(76) 
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FIG. 7: Cumulative distribution for the mapping of the grow- 
ing model for different values of the parameter (3 (/3 — 1/3, 1/2 
and 10/11). The average degree is in all cases set to (fc) = 6. 
The size of the network is N = 10 6 . 



Applying Tauberian theorems |49j, it follows from the 
singularity P(z) ~ (1 — z) 1 ^ in the vicinity of z = 1, 
the large k behavior of the degree distribution, namely 
P(k) ~ fc~ 1 ~ 1 /' 3 . That is, the model recovers a scale- 
free network, P(k) ~ k^ 1 , with a degree exponent 7 = 
1 + 1//3, and a cut-off given by the maximum degree 
kmax ~ T 13 ~ TV 1 ^ 7 " 1 ^, in agreement with the results 
obtained for growing network models Q . 

In order to check this result, we have numerically gen- 
erated networks of size N = 10 6 , with the connection 
probability Eq. (|7L)fl . For a rate of addition of new 
vertices X = 1, the numerical prefactor in r(t, t') is 
a = — /3)/2; we impose (k) = 6. Fig. [7| shows 

the numerical cumulated degree distributions obtained 
for values (3 = 1/3, 1/2, and 10/11. The plots show a 
clear power-law behavior in all three cases, with a de- 
gree exponent, estimated from a linear fit in the scaling 
region, given by 7 = 3.90, 3.07, and 2.14, respectively. 
This values compare very well with the theoretical pre- 
diction 7 = 1 + 1//3, that provides the expected exponents 
4, 3, and 2.1. 

The ANND function, k nn (k), can also be analyzed us- 
ing our formalism. By means of Eq. (|28(l . assuming a 
Poisson form for the propagator, we can define the gen- 
erating function ^(z) — ^2 k z k kP(k) [k nn (k) — l] , that 
takes the form 

*(*) = j^j f Ae*W(*-« £ dt'r(t, t')k(t'), (77) 

from where it is possible to derive the large k limit of the 
ANND. We are primary interested in the case (3 > 1/2, 
that is, the scale-free range of the model. Focusing in 
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/? > 1/2, the limit T -> 00 of Eq. O is 

1 j /3(2/3-l) 7 ri-/3 e aT ' U8j 

where we have used the same change of variables as be- 
fore. An expansion of this equation around z — 1 leads 
to 

Applying again Tauberian theorems, we can write that, 
in the large k limit, 

kP(k) (k n n(k) - 1) ~ T 2 ?- 1 ^, (80) 

from where it is straightforward to derive the large k limit 
of the ANND: 

k nn (k) ~ NP-iMt-Vk-Q-^. (81) 

The case (3 — 1/2 is very similar to the previous one, 
except for the type of divergence with the system size 
appearing as a prefactor. In the large T limit, we can 
write 

~ 2a 2 X 2 zlnT f J- e -2«^(i-)^ 1/2 dr. (82) 
Jo T ' 

Using the same arguments we conclude that the right 
hand side of this equation scales as k~ 2 and, therefore, 
the ANND converges to a constant value proportional to 
In A. 



VII. CONCLUSIONS 

In this paper we have analyzed in detail a general class 
of complex network models which are based on the ex- 
istence of a hidden space, in which vertices are located, 
and a connection probability that depends on the hid- 
den variable of each vertex. The Markovian character 
at the hidden level allows to calculate analytical expres- 
sions for the most important structural properties, such 
as degree distribution, the ANND function — quantifying 
two vertices correlations — and clustering coefficient, as a 
measure of three vertices correlation. Our formalism is 
valid for both sparse and non-sparse networks, extending 
the applicability of our results to a wide range of complex 
networks. At this respect, one of the applications of our 
formalism is to provide the analytical solution of a re- 
cently introduced model with intrinsic fitness, which has 
recently attracted a great deal of interest as a way to ob- 
tain scale-free networks without preferential attachment. 
Our solution has been successfully contrasted with nu- 
merical simulations, thus validating the accuracy of our 
formalism. 

Another interesting result of our analysis is to provide a 
new algorithm for generating correlated random networks 
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with an a priori specified correlation structure. In this 
case, we also calculate exact formulas for the relevant 
quantities. We have tested the algorithm using a probe 
joint distribution P(k, k'), with very encouraging results. 

Perhaps the most striking result concerns the applica- 
tion of the formalism to growing networks. Even though, 
in this case, the network is out of equilibrium, it is possi- 
ble to map it to a specific kind of hidden variables model 
by the identification of the injection time as the hidden 
variable. In order to check this point we have applied the 
method to a general class of growing networks, which, as 
a particular case, contains the Barabasi-Albert model. 
Using our formalism, we have recovered all the known 
results for this models, both for the degree distribution 
and the correlation structure. It is remarkable that, from 



a static approach, our formalism is able to derive correct 
results for non-equilibrium evolving networks. Therefore, 
this approach opens a novel and appealing way to study 
such systems. 
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